Calibration of Hand - held Camera Sequences for Plenoptic Modeling
ثبت نشده
چکیده
In this contribution we focus on the calibration of very long image sequences from a hand-held camera that samples the viewing sphere of a scene. View sphere sampling is important for plenoptic image-based modeling approaches that try to capture the appearance o f a s c ene by storing images from all possible directions. The plenoptic approach is appealing since it allows in principle fast scene rendering of scenes with complex geometry and surface reeections, without the need for an explicit geometrical scene model. However, the acquired images have to be c alibrated b e-fore plenoptic modeling can be used, and current approaches mostly use pre-calibrated a c quisition systems. This limits the generality of the approach. We propose a way out by using an uncalibrated hand-held camera only. The image sequence is acquired b y simply waving the camera around the scene objects, creating a zigzag scan path over the viewing sphere. We extend the sequential camera tracking of an existing structure-from-motion approach to a simultaneous multi-viewpoint camera t r acking. A mesh of camera viewpoints is computed that approximates the view sphere. The geometry and topology of the viewpoint mesh is computed automatically from the image sequence by weaving the sequential zigzag path into a connected viewpoint mesh. The viewpoint mesh is then used for view-dependent rendering. Novel views are generated b y piecewise mapping and interpolating the new image from the nearest viewpoints according to the viewpoint mesh. Local surface geometry can further enhance the interpolation process. Extensive experiments with ground truth data and hand-held sequences connrm the performance of our approach.
منابع مشابه
Calibration of Hand - held Camera Sequences for Plenoptic Modeling
In this contribution we focus on the calibration of very long image sequences from a hand-held camera that samples the viewing sphere of a scene. View sphere sampling is important for plenoptic (image-based) modeling approaches that try to capture the appearance of a scene by storing images from all possible directions. The plenoptic approach is appealing since it allows in principle fast scene...
متن کاملCalibration of Hand-Held Camera Sequences for Plenoptic Modeling
In this contribution we focus on the calibration of very long image sequences from a hand-held camera that samples the viewing sphere of a scene. View sphere sampling is important for plenoptic (image-based) modeling that captures the appearance of a scene by storing images from all possible directions. The plenoptic approach is appealing since it allows in principle fast scene rendering of sce...
متن کاملPlenoptic Modeling of 3D Scenes with a Sensor-augmented Multi-Camera Rig
We propose a system for robust modeling and visualisation of complex outdoor scenes from multi-camera image sequences and additional sensor information. A camera rig with one or more fire-wire cameras is used in conjunction with a 3-axis rotation sensor to robustly obtain a calibration of the scene with an uncalibrated structure from motion approach. Dense depth maps are estimated with multi-vi...
متن کاملCalibration and Accuracy Analysis of a Focused Plenoptic Camera
In this article we introduce new methods for the calibration of depth images from focused plenoptic cameras and validate the results. We start with a brief description of the concept of a focused plenoptic camera and how from the recorded raw image a depth map can be estimated. For this camera, an analytical expression of the depth accuracy is derived for the first time. In the main part of the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999